ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design

Vision Transformers (ViTs) have achieved state-of-the-art performance on various vision tasks. However, ViTs' self-attention module is still arguably a major bottleneck, limiting their achievable hardware efficiency. Meanwhile, existing accelerators dedicated to NLP Transformers are not optimal for ViTs. This is because there is a large difference between ViTs and NLP Transformers: ViTs have a relatively fixed number of input tokens, whose attention maps can be pruned by up to 90% even with fixed sparse patterns; while NLP Transformers need to handle input sequences of varying numbers of tokens and rely on on-the-fly predictions of dynamic sparse attention patterns for each input to achieve a decent sparsity (e.g., >=50%). To this end, we propose a dedicated algorithm and accelerator co-design framework dubbed ViTCoD for accelerating ViTs. Specifically, on the algorithm level, ViTCoD prunes and polarizes the attention maps to have either denser or sparser fixed patterns for regularizing two levels of workloads without hurting the accuracy, largely reducing the attention computations while leaving room for alleviating the remaining dominant data movements; on top of that, we further integrate a lightweight and learnable auto-encoder module to enable trading the dominant high-cost data movements for lower-cost computations. On the hardware level, we develop a dedicated accelerator to simultaneously coordinate the enforced denser/sparser workloads and encoder/decoder engines for boosted hardware utilization. Extensive experiments and ablation studies validate that ViTCoD largely reduces the dominant data movement costs, achieving speedups of up to 235.3x, 142.9x, 86.0x, 10.1x, and 6.8x over general computing platforms CPUs, EdgeGPUs, GPUs, and prior-art Transformer accelerators SpAtten and Sanger under an attention sparsity of 90%, respectively.Comment: Accepted to HPCA 202

Genome-Wide Association Studies Reveal the Genetic Basis of Ionomic Variation in Rice

Rice (Oryza sativa) is an important dietary source of both essential micronutrients and toxic trace elements for humans. The genetic basis underlying the variations in the mineral composition, the ionome, in rice remains largely unknown. Here, we describe a comprehensive study of the genetic architecture of the variation in the rice ionome performed using genome-wide association studies (GWAS) of the concentrations of 17 mineral elements in rice grain from a diverse panel of 529 accessions, each genotyped at ∼6.4 million single nucleotide polymorphism loci. We identified 72 loci associated with natural ionomic variations, 32 that are common across locations and 40 that are common within a single location. We identified candidate genes for 42 loci and provide evidence for the causal nature of three genes, the sodium transporter gene Os-HKT1;5 for sodium, Os-MOLYBDATE TRANSPORTER1;1 for molybdenum, and Grain number, plant height, and heading date7 for nitrogen. Comparison of GWAS data from rice versus Arabidopsis (Arabidopsis thaliana) also identified well-known as well as new candidates with potential for further characterization. Our study provides crucial insights into the genetic basis of ionomic variations in rice and serves as an important foundation for further studies on the genetic and molecular mechanisms controlling the rice ionome

High-Resolution Remote Sensing Data Classification over Urban Areas Using Random Forest Ensemble and Fully Connected Conditional Random Field

As an intermediate step between raw remote sensing data and digital maps, remote sensing data classification has been a challenging and long-standing problem in the remote sensing research community. In this work, an automated and effective supervised classification framework is presented for classifying high-resolution remote sensing data. Specifically, the presented method proceeds in three main stages: feature extraction, classification, and classified result refinement. In the feature extraction stage, both multispectral images and 3D geometry data are used, which utilizes the complementary information from multisource data. In the classification stage, to tackle the problems associated with too many training samples and take full advantage of the information in the large-scale dataset, a random forest (RF) ensemble learning strategy is proposed by combining several RF classifiers together. Finally, an improved fully connected conditional random field (FCCRF) graph model is employed to derive the contextual information to refine the classification results. Experiments on the ISPRS Semantic Labeling Contest dataset show that the presented 3-stage method achieves 86.9% overall accuracy, which is a new state-of-the-art non-CNN (convolutional neural networks)-based classification method

Numerical Simulation of Lost-Foam Casting for Key Components of A356 Aluminum Alloy in New Energy Vehicles

The intricate geometry and thin walls of the motor housing in new energy vehicles render it susceptible to casting defects during conventional casting processes. However, the lost-foam casting process holds a unique advantage in eliminating casting defects and ensuring the strength and air-tightness of thin-walled castings. In this paper, the lost-foam casting process of thin-walled A356 alloy motor housing was simulated using ProCAST software (2016.0). The results indicate that the filling process is stable and exhibits characteristics of diffusive filling. Solidification occurs gradually from thin to thick. Defect positions are accurately predicted. Through analysis of the defect volume range, the optimal process parameter combination is determined to be a pouring temperature of 700 °C, an interfacial heat transfer coefficient of 50, and a sand thermal conductivity coefficient of 0.5. Microscopic analysis of the motor housing fabricated using the process optimized through numerical simulations reveals the absence of defects such as shrinkage at critical locations

Multi-source coordinated stochastic restoration for SOP in distribution networks with a two-stage algorithm

After suffering from a grid blackout, distributed energy resources (DERs), such as local renewable energy and controllable distributed generators and energy storage can be used to restore loads enhancing the system’s resilience. In this study, a multi-source coordinated load restoration strategy was investigated for a distribution network with soft open points (SOPs). Here, the flexible regulation ability of the SOPs is fully utilized to improve the load restoration level while mitigating voltage deviations. Owing to the uncertainty, a scenario-based stochastic optimization approach was employed, and the load restoration problem was formulated as a mixed-integer nonlinear programming model. A computationally efficient solution algorithm was developed for the model using convex relaxation and linearization methods. The algorithm is organized into a two-stage structure, in which the energy storage system is dispatched in the first stage by solving a relaxed convex problem. In the second stage, an integer programming problem is calculated to acquire the outputs of both SOPs and power resources. A numerical test was conducted on both IEEE 33-bus and IEEE 123-bus systems to validate the effectiveness of the proposed strategy

Antiobesity, Antidiabetic, Antioxidative, and Antihyperlipidemic Activities of Bioactive Seaweed Substances

Bioactive seaweed substances such as alginate, carrageenan, agar, fucoidan, polyphenols, polyunsaturated fatty acids, amino acids, and protein have many physiological functions. They have been widely used in consumer products such as functional foods, marine nutraceuticals, biomedical materials, cosmetics, and many other products that offer health benefits, which are unique and different to those obtained from other sources. This chapter summarizes the antiobesity, antidiabetic, antioxidative, and antihyperlipidemic activities of various bioactive seaweed substances